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(54) Communication links for transmission of data in fixed size packets 



(57) Where a stream ot data is passed along an in- 
termediate link L-i, L2 etc at a higher overall data rate 
than outside the intermediate link, such as when inverse 
multiplexing is used in asynchronous transfer mode 
where a number of low speed data links L-, etc are used 
to emulate a data link which is higher speed than the 
original incoming stream of data, the splitting of the data 
into the multiple streams necessitating the insertion of 
control packets into the links in order to correct for the 
disparity in propagation time along the links, the inter- 
faces such as I M and I M containing buffers for data 
packets before transmission down the intermediate 



links and after reception at the end of the intermediate 
links, in order to eliminate cell delay variation, which has 
the result that cells in the output stream can vary by up 
to two cell positions relative to that in the input cell 
stream because of the different quantisation of the in- 
termediate link and because of the need to send control 
packets, arrangements are made for the queue in the 
input buffer and in the output buffer to be maintained at 
a constant number of cells, for example by passing in- 
formation on the input buffer length in the control cells, 
so that the reconstructed data stream is exactly the 
same as the incoming data stream, although delayed by 
a fixed additional two cell delay. 
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Description 

This invention relates to comnnunication links for 
transmission of data in fixed size packets. 

The invention particularly relates to ATM (asynchro- 
nous transfer mode) which uses connnnunication links 
between nodes for example computers to transmit in- 
formation in small packets known as cells, typically 53 
byte long, which are short enough for delay sensitive 
devices but long enough for data, according to an ITU- 
T Recommendation 1.150; 

ATM typically uses wideband links e.g. optical fibres 
typically between 25-620 Mbit/sec and above, but this 
causes a problem when such links are not available. 

One technique which has been developed to over- 
come this problem is so-called inverse multiplexing (US- 
A-5 251 210). (A specification for Inverse Multiplexing 
for ATM (IMA) is under discussion at the ATM Forum.) 
Referring to Figure 1, an incoming stream of data 
clocked at e.g. 30 Mbit/sec is input into a first interface 
IMA*" (inverse multiplexing for ATM), which distributes 
the cells cyclically between sixteen standard lower 
speed links L^. Lg, etc which operate at 2 Mbit/sec. 
The interface IMA^has control circuitry and a transmitter 
and IMA^ has a receiver and control circuitry, in order to 
reassemble the original data stream. In this way a 
number of slow speed links emulate one higher speed 
link. 

The links are physically separate paths and indeed 
could be totally different in character e.g. could be a 
telephone line. L2 could be a microwave land link, and 
L3 could be a satellite link. Propagation delays would 
then be widely different e.g. the fastest could be 2 ms 
and the slowest could be 18 ms. 

For this reason, the inverse multiplexing technique 
entails the addition of control cells at regular intervals in 
the links etc every M data cells (where M is typically 
in the range 32-256). which contain timing information 
which enables the data stream to be reassembled in the 
correct order at IMA^. 

This means that the total data rate across the link 
from IMA^ to IMA^ must exceed that of the data rate 
through the communication link as a whole i.e. before 
IMA"" and after IMA^. Because the data rate is higher, 
the quantisation steps (in time) are smaller, and do not 
keep step with those for the communication link as a 
whole. 

Referring to Figure 2. IMA^ has a transmitter Tx 
which distributes incoming traffic cells (interspersed 
with unused (idle) cells), forming a continuous stream 
("traffic") to each linkLi ®tc in turn in round robin fashion 
under the instructions of control circuitry ("control"). 

Figure 3 shows these time slots in symbolic fashion. 
Time increases in a downwardly vertical direction as 
seen in Figure 3. Thus, the ATM stream arriving at IMA"" 
consists of traffic cells c^, Cg interspersed with idle (i.e. 
unused) cells I. These arrive at the data rate of the in- 
coming ATM stream. 



The time slots between IMA^ and IMA^ in Figure 3 
show the time of entry of the traffic and idle packets onto 
the intermediate links L, to L^g The slots are slightly 
closer together than those of the incoming ATM stream. 

5 Thus a situation can arise as is shown for traffic packet 
Cg where the time slot for the particular link, say. Lg, has 
already arrived before the traffic packet Cg is available 
for transmission. IMA^ thus has a means (Figure 2) of 
generating filler packets ("filler") to maintain the streams 

10 of data along the intermediate links continuous. Traffic 
packet C2 is transmitted along the third link in the next 
time slot. 

Another problem arises after traffic slot C5 has be- 
come available for transmission. Instead of being trans- 

'5 mitted down link L7 the position has been reached 
whereby 31 data cells have been fed down this link, ne- 
cessitating a control cell to be inserted. Traffic cell C5 is 
therefore transmitted along the next available link Lg. 
IMA2 is the inverse of the arrangement of IMA^ 

20 shown in Figure 2, in that the cells are re-assembled into 
the order of the original stream, utilising the information 
contained in the control cells. It will be seen that the 
quantisation steps of the traffic and idle packets to the 
right' of vertical line IMA^ in Figure 3 are the same as 

25 those of the incoming data stream, but obviously there 
is a considerable time differential between them be- 
cause of the propagation delay along the intennediate 
links which has not been illustrated in Figure 3. It will be 
noticed that the transmission of traffic cell c^ along link 

30 results in traffic cell c^ in the recombined ATM stream. 
However, the next cell that was sent was a filler cell, and 
this is discarded at IMA^. Since there is no cell to send, 
the receiver generates an idle cell i.e. an unused cell 
which it transmits after traffic cell c^. 

55 It will also be noticed that the control cell is discard- 
ed in the receiver, but this time traffic cell C4 has already 
arrived so there is no need for an idle cell to be gener- 
ated. 

Both IMA^ and I MA^ contain buffers for queuing the 

40 traffic and idle cells. The buffer in IMA"" is provided be- 
cause of the quantisation discrepancy between the data 
rates and also because of the need to generate control 
cells. The buffer at the output is provided similarly be- 
cause of the disparity in quantisation rates and also be- 

45 cause of the need to discard filler or control cells without 
leaving gaps in the reconstructed ATM stream. 

It is recognised that even with these buffers, indi- 
vidual cells of the recombined stream may be displaced 
due to the insertion of idle cells as described above, re- 

50 suiting in so-called cell delay and that this cell delay can 
vary by an amount up to two cells' length. The maximum 
delay of two cells could be due to the fact that the cell 
has just missed an opportunity across a link, and the 
next link is due to send a controll cell. This cell delay 

55 variation (CDV) can cause problems for services that 
are operating close to their permitted performance limits 
and may cause problems at subsequent policing points 
in the network. 
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The invention is attempting to eliminate this cell de- 
lay variation, but is not simply applicable to asynchro- 
nous transfer mode with inverse multiplexing, but is 
more generally applicable to any communication link 
which includes an intermediate link or links which col- 
lectively have a higher data rate than the original data 
stream. 

The invention provides a communication link for the 
transmission of data in fixed size packets, comprising at 
least one intermediate link, the total data rate of which 
exceeds that of the communication link, a buffer for 
queuing packets before transmission into one end of the 
intermediate link(s). a buffer for queuing packets after 
reception at the other end of the intermediate link(s), and 
queue length means for transmitting information on the 
queue length before transmission, along the intermedi- 
ate link(s) and for maintaining the input queue length 
plus the output queue length at a fixed number of pack- 
ets. 

The queue length means makes it possible to rec- 
reate, after the intermediate link(s), exactly the packet 
stream before the intermediate link(s) despite the differ- 
ent quantisation of the intermediate link(s). 

A communication link for the transmission of traffic 
in fixed size packets constructed in accordance with the 
invention will now be described, by way of example, with 
reference to the accompanying drawings, in which: 

Figure 1 is a symbolic representation of known ATM 
using inverse multiplexing (IMA); 

Figure 2 is a symbolic representation of IMAV 

Figure 3 is a symbolic representation of time slots 
in the intermediate links and in the main ATM stream 
corresponding to Figures 1 and 2; 

Figure 4 is a view corresponding to Figure 3 but with 
the communication link of the invention; 

Figure 5 is a representation of the communication 
link of the invention; 

Figure 6 is a further representation of the data link 
of Figure 5 in more detail; 

Figure 7 is an algorithm showing the routine to be 
performed by the input buffer; and 

Figure 8 is an algorithm showing the routine to be 
performed by the output buffer. 

The communication link according to the Invention 
has all the features of the communication link described 
with reference to Figures 1 and 2 of the accompanying 
drawings showing the known inverse multiplexing (IMA) 
application for asynchronous transfer mode (ATM). A 
single incoming data stream is cyclically divided into M 



slower speed data links using a transmitter as shown in 
Figures 1 and 2. the multiple Intermediate links emulat- 
ing a single link of higher data rate than the incoming 
ATM stream. Since the M links have different propaga- 

5 tlon delays, control cells are sent along each of the mul- 
tiple Intermediate links M (similar to the links etc) eve- 
ry predetermined number of traffic or idle cells sent 
along those links. These control cells contain informa- 
tion which enables the original ATM data stream to be 

10 recombined in the correct order at the receiver IMA2. 
Filler cells are similarly generated for the reasons de- 
scribed with reference to Figure 3. 

Again, as was provided in the known IMA applica- 
tion of Figures 1 to 3. a buffer for queuing cells before 

IS transmission into the intermediate links and another 
buffer for queuing cells after reception at the other end 
of the Intenmediate links are provided. 

Figure 5 shows the essential features of the com- 
munication link. 

20 In accordance with the invention, the communica- 
tion link of Figure 5 is provided with queue length means 
(not shown) which is responsible for transmitting infor- 
mation on the queue length in the input buffer along the 
intermediate links and for maintaining the Input queue 

25 length plus the output queue length at a constant 
number ot cells. Referring to Figure 6. the input buffer 
is a two cell first-in, first-out (FIFO) buffer, as is the out- 
put buffer, and the queue length means is responsible 
for arranging that two cells and only two cells are stored 

30 in totality between those two buffers. 

The IMA control function in Figure 6 (corresponding 
to "control" in Figure 2) operates in accordance with the 
protocol illustrated in Figure 7. This is In two parts, the 
actions on receipt of a cell, and the actions when a cell 

3S is due to be sent to a link. These parts are separated by 
the input FIFO. The receiver adds to the FIFO buffer. 
The sender removes cells from the FIFO buffer. The se- 
lection unit (corresponding to Tx in Figure 2) dispatches 
a cell from the buffer, a control cell or filler cell as appro- 
ve priate. A corresponding control function at the receive 
end performs the operations in Figure 8, The top part of 
Figure 8 is concerned with the receipt of a cell along an 
intermediate link and the lower part is concerned with 
sending the cell into the recombined ATM stream. The 

45 output FIFO separates these two elements. 

Thus, the control cells are used to enable the re- 
ceiver to check that the queue in the input buffer and the 
queue in the output buffer equals exactly two cells. The 
information could be contained in two spare bits of the 

so link stuff indication byte or any other convenient field. If 
the combined length of the queue is too short, as will be 
the condition at start-up, the receiver loads two idle cells 
into the receive buffer. If there are too many cells in the 
output buffer to produce a combined length of two celts 

55 between the two buffers, this represents an error and 
the next idle cell is discarded. Under normal operating 
conditions, in the absence of errors the input queue 
should never be two cells long when a control celt is 
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sent. 

There are two types of errors that can confuse the 
system. Control or filler cells being corrupted and look- 
ing like ordinary traffic, this would cause the output FIFO 
to have too many cells in it. A corrupt cell being treated 
as a control (or more likely a filler cell). This will cause 
the FIFO to have too few cells in it, though the corrupt 
cell is likely to be detected through other mechanisms. 

It is necessary to control the start-up of the output 
FIFO and check its size while the system is running. The 
input FIFO before sending a cell across the intermediate 
links and the length of the output FIFO after transfer 
across the links (and allowing for the retiming of the 
links) should at any time be exactly two cells in total as 
stated. 

On the input side traffic would be discarded until the 
link is operational, and thus the initial condition could 
just be met by simply loading two idle cells into the exit 
FIFO. A slightly better system that allows the loading of 
the two FIFOs to be checked during operation would be 
to encode the length of the input FIFO into the control 
cells, leaving it to the terminating end to ensure that exit 
FIFO is the correct length (when it wants to be). The 
information could be passed in two spare bits of the link 
stuff indication byte. 

In normal operating conditions, the input FIFO will 
contain zero cells and the output FIFO two cells. There 
will be times when the input FIFO and the output FIFO 
each contain one cell, and times when the input FIFO 
contains two cells, with the output FIFO containing no 
cells. The latter situation could arise if a filler cell was 
sent, followed by a control cell, i.e. due to quantisation 
and control. In general, queues will tend to move from 
the input to the output because the overall rate of the 
intermediate links is faster. 

With the arrangement of the invention, at the receiv- 
ing end, the control and filler cells are removed without 
adding idle cells to the traffic. With previously known 
IMA systems, control cells and filler cells were discard- 
ed, but either cells could have resulted in the generation 
of idle cells in the output data stream, as in the example 
illustrated in Figure 3. 

Referring to Figure 4, the use of the queue length 
means means that under normal conditions, the output 
buffer must have two cells in it so that even if filler and 
control cells are sent consecutively, there will be no 
need to generate an idle cell (say between c^ and Cg in 
Figure 3) in the reconstructed ATM stream (the maxi- 
mum delay of two cells could be due to the fact that the 
cell has just missed an opportunity across a link, and 
the next link is due to send a control cell). 

While it has been stated that two cells are stored in 
combination in the input and output buffers, any fixed 
number of cells could be stored. One stored cell would 
suffice for decoupling (overcoming the quantisation dis- 
parity) but would not overcome the problems of control 
cells. Three or more cells could be queued, but would 
add unnecessarily to the fixed delay. In other systems 



where for example more control cells were sent, the min- 
imum number of cells needed to be queued to eliminate 
cell delay variation could be three or more. 

While the invention has been described in terms of 
s inverse multiplexing for asynchronous transfer mode, 
the invention is applicable to any intermediate link of 
higher data rate than a main link, in order to avoid vari- 
able delays due to the different quantisation of the inter- 
mediate link. 



Claims 

1. A communication link for the transmission of data 
IS in fixed size packets, comprising at least one inter- 
mediate link, the total data rate of which exceeds 
that of the communication link, a buffer for queuing 
packets before transmission into one end of the in- 
termediate link(s), a buffer for queuing packets after 

20 reception at the other end of the intermediate link 
(s), and queue length meams for transmitting infor- 
mation on the queue length before transmission, 
along the intermediate link(s) and for maintaining 
the input queue length plus the output queue length 
25 at a fixed number of packets. 

2. Acommunicationlinkasclaimedinclaim 1, inwhich 
the fixed number of packets is two. 

30 3. A communication link as claimed In claim 1 or claim 
2, in which the queue length means is arranged so 
that, on start-up when both buffers are empty, the 
buffer for storing received packets is filled with two 
unused packets. 

35 

4. A communication link as claimed in any one of 
claims 1 to 3, in which the information on the queue 
length before transmission is encoded in control 
cells sent along the intermediate links. 

40 

5. A communication link as claimed in any one of 
claims 1 to 4, in which there are a plurality of inter- 
mediate links, each of which has a data rate less 
than that of the communication link. 

45 

6. A communication linkas claimed in claim 5, inwhich 
the link is adapted for inverse multiplexing in asyn- 
chronous transfer mode in which a continuous 
stream of traffic packets interspersed with unused 

so packets is transmitted, wherein a transmitter for 
transmitting packets into one end of the intermedi- 
ate links is arranged to transmit into each interme- 
diate link a respective control packet after a prede- 
termined number of packets have been sent along 

55 that link, the control packet containing information 
to enable the differential propagation delays of each 
link to be corrected for, and wherein the receiver at 
the other end of the intermediate links is arranged 
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to discard the control packet so that it is not forward- 
ed to the output buffer. 

7. A communication link as claimed in claim 5 or claim 
6, in which the transmitter Is arranged to transmit 5 
filler packets down the next intermediate link If no 
incoming packet is available for transmission, and 
the receiver at the other end Is arranged to discard 
the filler packet so that it is not forwarded to the out- 
put buffer. 10 
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links and after reception at the end of the intermediate 
links, in order to eliminate cell delay variation, which has 
the result that cells in the output stream can vary by up 
to two cell positions relative to that in the input cell 
stream because of the different quantisation of the in- 
termediate link and because of the need to send control 
packets, arrangements are made for the queue in the 
input buffer and in the output buffer to be maintained at 
a constant number of cells, for example by passing in- 
formation on the input buffer length in the control cells, 
so that the reconstructed data stream is exactly the 
same as the incoming data stream, although delayed by 
a fixed additional two cell delay 
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